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absolute deviation (LAD) models were built using a computer subroutine that 
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A Method for Selecting Between Fisher’s Linear Classification Functions 
and Least Absolute Deviation in Predictive Discriminant Analysis 

ABSTRACT. A method for comparing the cross-validated classification 
accuracy of Fisher’s linear classification functions and least absolute 
deviation is presented under varying data conditions for the two-group 
classification problem. With this method, separate-group as well as 
total- sample proportions of correct classifications can be compared for 
the two classification procedures. McNemar's (1947) test for contrasting 
correlated proportions is used in statistical comparisons of separate-group 
and total-sample proportions. The method is illustrated with 22 real data 
sets. 

Standard techniques for solving the two-group classification problem, such as 
ordinary least squares (OLS) and Fisher’s linear classification functions (FLCFs) 1 , are 
based on assumptions of multivariate normality and equality of group covariance 
matrices. Mathematical programming (MP) solution techniques are not. 

Consequently, we might expect an MP approach to yield greater cross-validated 
classification accuracy than a standard approach for nonnormal data or data with 
unequal group covariance matrices. 

Joachimsthaler and Stam (1990) reviewed the literature on studies comparing the 
accuracy of MP and standard approaches, and concluded that some MP approaches 
outperform some standard approaches some of the time, but no MP approach 
outperforms all standard approaches all of the time. Thus, studies comparing the cross- 
validated classification accuracy of MP and standard approaches (e.g., Bajgier & Hill, 
1982; Freed & Glover, 1986; Joachimsthaler & Stam, 1990; Stam & Joachimsthaler, 
1989, 1990) provide only partial support for the expectation that MP approaches will 
be more accurate than standard approaches when assumptions are violated. 

One MP technique that shows promise as an alternative to standard classification 
approaches is least absolute deviation (LAD). This procedure was discussed by 
Armstrong, Frome, and Sklar (1980) in the multiple regression context as an alternative 
to OLS, especially for applications involving nonnormal distributions. Morris and 
Huberty (1983) surmised that LAD might also be appropriate for classification because 
the absolute rather than squared deviation between predicted and actual dichotomous 
scores determines the group to which a case is classified. 

This conjecture has received empirical support from two simulation studies. 
Morris and Huberty (1983) compared the cross-validated classification accuracy of 
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LAD and OLS across a wide variety of data conditions, and found a small but 
consistent advantage of LAD over OLS. Lee and Ord (1990) compared LAD to 
several MP solution techniques and to OLS, and concluded that LAD performs at least 
as well as these other procedures. Furthermore, Lee and Ord note that LAD is easy to 
implement and inexpensive to run. 

At this point, then, we know that LAD has performed as well as, or better than, 
OLS using simulated data. However, we do not know whether this result replicates 
when LAD is compared with FLCFs using real data sets. To address this issue, a 
method for comparing the cross-validated classification accuracy of LAD and FLCFs 
for a specific data set is introduced and demonstrated. This method will enable 
researchers to select the optimal classification procedure for a specific data set, 
regardless of data conditions. 



Method 

Data Source : Initially, 33 classification data sets varying in number of cases, number of 
predictor variables, degree of group separation, and equality of group covariance 
matrices were selected to illustrate the method. However, for 11 of these data sets, the 
algorithm used to obtain weights for LAD failed to converge. Consequently, only 22 
data sets were employed to illustrate the method. To bolster validity, all of the data 
sets were taken from real classification studies (Hekelman, Zyzanski, & Flocke, 1995; 
Morris & Huberty, 1987). 

Procedure : FLCFs were built based on assumptions of multivariate normality, equal 
covariance matrices, and equal prior probabilities of group membership. Cases were 
classified into groups using Tatsuoka's (1988, p. 351) minimum chi-squared rule. We 
assumed equal priors because population sizes were unknown. The use of sample sizes 
as estimates of relative population sizes is not recommended when population sizes are 
unknown (Huberty, 1994, p. 65; Meshbane & Morris, 1995b). 

LAD models were built using a computer subroutine that incorporates linear 
programming code (Armstrong, Frome, & Kung, 1979). The weights generated by 
this algorithm minimize the sum of absolute deviations between predicted and actual 
criterion scores. 

In comparing the predictive accuracy of LAD and FLCFs, external rather than 
internal results were considered. Results of an internal classification analysis are those 
obtained when measures for the individuals on whom the statistics were based are 
resubstituted to obtain the predicted classification scores. In an external classification 




analysis, statistics based on one set of individuals are used in classifying new 
individuals. An external analysis is appropriate for making inferences about the 
discriminatory power of the predictors for a new set of data (Huberty, 1994, p. 110). 

External, or cross-validated, hit-rate accuracy was estimated using the leave- 
one-out procedure. A case was classified by applying the function derived from all 
cases except the one being classified. This process was repeated round-robin for each 
case with a count of the overall classification accuracy used to estimate the cross- 
validated accuracy. This procedure, and the analogous PRESS (ERedicted Error Sum 
of Squares) procedure (Allen, 1971) for multiple regression, has a relatively wide 
following in both the discriminant analysis and multiple regression literature (see, for 
example, Allen, 1971; Allen & Cady, 1982; Huberty, 1994; Huberty & Mourad, 1980; 
Lachenbruch, 1967; Mosteller & Tukey, 1968). 

McNemar's (1947) statistic for correlated proportions was used in the statistical 
comparisons of LAD and FLCF hit rates for separate-group and total-sample 
proportions. This method was previously suggested for comparing full and reduced 
classification models (Morris & Huberty, 1995) and linear and quadratic classification 
models (Meshbane & Morris, 1995a), and for selecting predictor variable subsets 
(Morris & Meshbane, 1995), but is equally applicable in comparing LAD and FLCFs. 
(See Looney, 1988, for a method of comparing classification results of more than two 
models.) Because the calculation of the McNemar correlated proportion statistic 
requires the joint distribution of hits and misses for both LAD and FLCFs, no statistical 
package will accomplish the method. Therefore, we wrote a FORTRAN computer 
program to provide this information, as well as to perform the other functions 
described in this section (i.e., determine LAD and FLCF weights, classify cases into 
groups, conduct the McNemar test and the Box test). 

We used the Box test for testing the assumption of homogeneity of covariance 
structures. This test is sensitive to multivariate normality , and the outcome is therefore 
confounded with the homogeneity of dispersion issue. Nevertheless, the Box test is 
routinely used for testing the homogeneity of dispersion assumption and is even the 
default in some statistical packages. Notwithstanding concerns over this test, one could 
argue that, theoretically, the LAD procedure is more likely to be appropriate when the 
Box test indicates that the covariance structures are unequal. 

Results 

For each of the data sets, Table 1 gives a short description, the degree of group 
separation (D) calculated using the centroid to centroid formula described by Huberty 
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(1994, p. 43), an index of disproportionality of the group sizes (I) calculated as (ji; * 
100) / nj, where ni is the larger of the two groups, the number of cases in group 1 (nj, 
the number of cases in group 2 (n 2 ), the number of predictor variables (p), results of 
the Box test for homogeneity of covariance structures, and a comparison of the leave- 
one-out (L-O-O) performance of LAD and FLCFs for the total sample and separately 
for each group. We compared the performance of the two classification procedures, 
displayed as the hit-rate percent obtained by the p predictor variables, via McNemar's 
test for contrasting correlated proportions. 



Insert Table 1 about here 



To illustrate the method for these data sets, we used the .01 alpha level with the 
associated critical z of 2.58. As can be seen in Table 1, differences between LAD and 
FLCFs in classifying the total sample were statistically significant in only two of the 
data sets (15 and 22). In both cases, FLCFs yielded significantly higher hit rates. 
Differences between the two classification procedures in separate-group hit rates were 
statistically significant in seven of the 22 data sets (8, 9, 10, 11, 15, 21, 22). In five of 
these data sets (10, 11, 15, 21, 22), FLCFs worked better. In the other two data sets 
(8, 9), LAD worked better. 

To assess practical significance, we calculated an index of improvement in hit 
rate over chance (described by Huberty, 1994, p. 107) for both LAD and FLCFs. We 
defined chance using the proportional chance criterion (see Huberty, 1994, p. 103). 

Our effect size measure was the difference between LAD and FLCFs in improvement 
over chance. Using a critical effect size of 10%, all statistically significant results were 
also of practical significance (effect sizes ranged from 15.84% in data set 11 to 47.25% 
in data set 8). 



Discussion 

While these results are partially consistent with those of Lee and Ord (1990), 
who reported similar misclassification rates for LAD and OLS procedures, the results 
are clearly inconsistent with Morris and Huberty (1983), who reported a small but 
consistent advantage of LAD over OLS across all data sets. The discrepancy between 
these findings and those of the current study may be related to relative group size. 
Specifically , in both the Lee and Ord and the Morris and Huberty studies, the sizes of 
the two groups were identical (Lee and Ord) or nearly so (Morris and Huberty). In the 
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current study, the sizes of the two groups were different (index of disproportionality 
1 1 8 or higher) in eight of the 22 data sets. 

For relative group size to be a plausible explanation for the inconsistent results, 
we would expect data sets with statistically significant differences in performance for 
LAD and FLCFs to have non-trivial differences in group sizes, and data sets yielding 
similar performance for the two procedures to have similar group sizes. As evident 
from Table 1, group sizes were different (index of disproportionality was 1 18 or 
higher) in five of the seven data sets with statistically significant differences in separate 
group hit rates between LAD and FLCFs. Furthermore, relative group sizes were 
similar (index of disproportionality was 1 13 or lower) in 12 of the 15 data sets in which 
the performance of LAD and FLCFs were similar. In the other three data sets, the 
Mahalanobis distance between groups was relatively high (D = 2.89 to 3.11), which 
may have negated the conjectured effect of discrepant group sizes in these data sets. 

Regardless of the reason(s) for the discrepant results, the relationship between 
data conditions and model performance is far from perfect. Thus, for a given data set, 
it is not yet possible to predict the relative performance of LAD and FLCFs on the 
basis of data conditions alone. Use of the method and computer program 2 demonstrated 
herein will allow researchers to compare the explicit cross-validated classification hit- 
rate accuracy of LAD and FLCFs for any specific data set and select the procedure that 
yields the higher total-sample or separate-group hit rate, depending on which hit rate is 
of interest. 



Notes 

1. A linear classification function is different from a linear discriminant function. 

2. For a copy of the FORTRAN program that accomplishes the method, send a 
returnable diskette and diskette mailer to Alice Meshbane, College of Education, 
Florida Atlantic University, P.O. Box 3091, Boca Raton, FL 33431-0991. Internet: 
Meshbane@acc .fau.edu. 



References 

Allen, D. M. (1971). The prediction sum of squares as a criterion for selecting 
predictor variables (Tech. Rept. No. 23). University of Kentucky, Department of 
Statistics. 



6 



Allen, D. M., & Cady, F. B. (1982). Analyzing experimental data by 
re gression . Belmont, CA: Wadsworth. 

Armstrong, R. D., Frome, E. L., & Kung, D. S. (1979). A revised simplex 
algorithm for the absolute deviation curve fitting problem. Communications in 
Statistics: Simulation and Computation. B8 . 175-190. 

Armstrong, R. D., Frome, E. L., & Sklar, M. G. (1980). Linear programming 
in exploratory data analysis. Journal of Educational Statistics. 4 . 293-307. 

Bajgier, S. M., & Hill, A. V. (1982). An experimental comparison of statistical 
and linear programming approaches to the discriminant problem. Decision Sciences, 

12, 604-618. 

Freed, N., & Glover, F. (1986). Evaluating alternative linear programming 
models to solve the two-group discriminant problem. Decision Sciences, 17 . 151-162. 

Hekelman, F. P., Zyzanski, S. J., & Flocke, S. A. (1995). Research in Hig her 
Education. 36 . 235-255. 

Huberty, C. J. (1994). A pplied discriminant analy sis. New York: Wiley. 

Huberty, C. J, & Mourad, S. A. (1980). Estimation in multiple 
correlation/prediction. Educational and Psychological Measurement, 40 . 101-112. 

Joachimsthaler, E. A., & Stam, A. (1990). Mathematical programming 
approaches for the classification problem in two-group discriminant analysis. 
Multivariate Behavioral Research^ . 427-454. 

Lachenbruch, P. A. (1967). An almost unbiased method of obtaining confidence 
intervals for the probability of misclassification in discriminant analysis. Biometrics, 
23 , 639-645. 

Lee, C. K., & Ord, J. K. (1990). Discriminant analysis using least absolute 
deviations. Decision Sciences, 21 . 86-96. 

Looney, S. W. (1988). A statistical technique for comparing the accuracies of 
several classifiers. Pattern Recognition Letters, 8 . 5-9. 




7 



McNemar, Q. (1947). Note on the sampling error of the differences between 
correlated proportions or percentages. Psychometrika r 12 . 153-157. 

Meshbane, A., & Morris, J. D. (1995a). A method for selecting between linear 
and quadratic classification models in discriminant analysis. The Journal of 
Experimental Education. 63 . 263-273. 

Meshbane, A., & Morris, J. D. (1995b, April). Assuming equal vs. unequal 
prior probabilities of group membership in discriminant analysis: Effect on predictive 
accuracy . Paper presented at the annual meeting of the American Educational Research 
Association, San Francisco, CA. 

Morris, J. D., & Huberty, C. J (1983, April). Some alternative classification 
wei ghting algorithms . Paper presented at the annual convention of the American 
Educational Research Association, Montreal. 

Morris, J. D. & Huberty, C. J (1995). Full versus restricted model testing in 
discriminant analysis. Journal of Experimental Education, 63 . 161-165. 

Morris, J. D., & Meshbane, A. (1995). Selecting predictor variables in two- 
group classification problems. Educational and Psychological Measurement. 55 . 438- 
441. 



Mosteller, F., & Tukey, J. W. (1968). Data analysis, including statistics. In G. 
Lindzey & E. Aronson (Eds.), Handbook of Social Psychology: Vol. 2. (pp. 80-203). 
Reading, MA: Addison- Wesley. 

Stam, A., & Joachimsthaler, E. A. (1989). Solving the classification problem in 
discriminant analysis via linear and nonlinear programming methods. Decision 
Sciences, 20 . 285-293. 

Stam, A., & Joachimsthaler, E. A. (1990). A comparison of a robust mixed- 
integer approach to existing methods for establishing classification rules for the 
discriminant problem. European Journal of Operations Research, 46 . 113-132. 

Tatsuoka, M. J. (1988). Multivariate analysis: Techniques for educational and 
psychological research (2nd ed.). New York: Macmillan. 




9 



Table 1 



OO 



§ 

a 

<D 

0. 

D 

-4— > 

Pi 



c 

o 

C/3 



cx 

S 

o 

U 



C/3 

<D 

o 

*c 

td 

s 

8 



> 

o 

U 



-4— » 

'IS 

3* 



C/3 
0) 
N 

{>0 
C 

o 

jj 

B. 

o 

PL, 

o 

3 

3 

c/3 H 

s 

w D 

r, C/3 

C 

.2 < 
a rg 

*c 

o 

C/3 

CD 

Q 



C/3 

<D 

H 



<8 

o 

C/3 



u 

H-l 

PU 



CD 

00 

fS 

cd 

Q 



Q 

< 






<N 

Q4 

a o 

p§ 



C* 

a 

3 

o 

H 



8 * 
g os 

(X ^ 

05 

J 

<2 w 

« s 

os ^ 
<d a> 
H g 

x 3 
cS § 
*8 § 
a w 



0) 



a 

J 

a* 



§ 

I 

0 

os 

a> 

a 

* 

00 

1 

Q 



o 

o 



O O o t-? 

o o § © 



o 

o 



8 8 g 
*— < 1— < . 



8 ^ 
q ii 

v t3I 

a 

00 






o 

oo 



o 

00 



o 

o 



r*- 

On 



ro 



% 

o 



I 

a 

i 



g S 9 



o o o 2 



o O o 

o o § 



o 

o 



o 

o 




8 2 

® II 

v 5a 

a 

oo~ 

00 

3 

OO* 

II 

cs 



o 

oo 



o 

oo 



VO 

© 



<N 



§- 

O 



I 

a 

I 

05 

£ 



<N 



Tf ^ § 

os on q 



h vo 5 

os os q 



395 

IX. J S 



o 

00 



•Si 



On 

ro 

8 






r- 

ro 



oo 

ro 



cs 

oo 



ro 

<* 

I 



a 

I 

os 

£ 

ro 



oo oo 
Os os 



VO Tt- 00 
On On 00 



r- vo oo 
On OS 0O 



PU _ 



oo 



N> 



a> 

£ 

o 

s 



"Si 



00 

Tt- 






o 

oo 



o 

oo 



o 

o 



r- 

r- 



ro 

CM 

vs 

r 



s 

Q 

I 



v=H 



o 




Table 1 cont. 



ON 



5 

6 

Oh 

2 

£ 



ll-H 

O 

g 

C/5 



CX 

6 

o 

U 



CM 

2 O 



& 



8 



00 © 
oo q 



eg 

a 



3 

o 

H 



§ ■s 

£ p 



cn wo 
on oo 



r-* m 
O oo 



f-H »-H O 
Os Os O 



Tj- Tf O 
On Os O 



cn cn 
On Os 




On cn P 
00 On n 



On tJ- S 
OO h ^ 
CM 



On C- *— • 
00 00 h 



tX hJ 2 



r- no © 

00 ^ o 

CM 



cn oo r: 
00 On cm 



Tf *—• On 

OO On oo 




c/5 

CD 

O 

*d 

c3 

s 

(D 

o 



1 

u 

<H-> 

o 

£* 

| 8 
ffK 

Vh CX 

£•£ 

tS * 

D -3 

H CX 

^ o 

V»-H ^ 

O cT 

00 W 
■*— » 

w) 

3 .g 

£ £ 

W 3 

~ C/5 

e 

.2 < 

K</> 

•c ^ 

(U 

S -2 

cd q 

oo 



U 

J 

Uh 



I 

Q 



Q 

3 



a 

cT 

cf 



a 

0 

1 

o 

Vi 

0) 

a 

oj 

oo 



Q 

=*t 



o o 

VO «-i 



a 



cn o 

o *-< 

© II 



r- — < 

C- On 



On *-h 
CM On 
On 

q ii 



CM 

r~- 



cm 

CM 



r- 

CM 



CM 

wo 



t 3I 



a 

cn 

r- 

Ov 



Tf 

» 



wo 

00 



On 

CM 



cn 

On 

CM 



cn 

v-H 

I 



3 

Q 

§ 



$1 



a 

W mm4 

CM 



W0 

cn 



cn 

CM 



On 

00 



CM 

<% 
NT— H 

! 

i 

5 

cd 

D 

I 

.3 

OQ 



-SI 



a 



cn 

CM 



r- 

cn 



On 

CM 



Tf 

CM 



cn 

* 

CM 

I 

3 

Q 

I 

.59 

OQ 



oo 



CV> 




o 



e 

o 

o 



<u 

H 



s 

i 

Ah 

£ 

55 

P4 



o 

c; 

0 

C/5 

1 

Oh 

6 

o 

U 

■o 

§ 

C/5 

<D 

O 

*c 

cd 

a 

<D 

O 



*8 

I 

u 

0 

S' 

1 S 3 

fc c 

<£ .2 

ts J2 

oi 3 

H 3, 

V/ O 

* Ah 



£ 



13 

<4-H ^5 

O Q" 1 

c/5 W 

<4— > 

q W) 

3 C 

£ s 

w 3 

cT <2 
.2 < 
Oh r 00 

*c * 

8 

D 



u 

J 

PU 

x» 



<D 

00 

I 

Q 



Q 

3 



oc 

a o 
<2 

Sj 

^ o 
H 



•8 - 
8 T 8 
s ^ 

o D 



Oh 

fl* 



§ 

1 

o 

CA 

© 

o 

a> 

oo 

€ 

Q 



r-* 


00 


<N 


<s 


<s 


2 


o 


o 


vn 


ON 


<N 


m 


i> 


00 


CO 


00 


r- 




00 


r> 


VO 


l> 


00 


r- 






CO 

1 






cn 






<N 






1 


ON 


r- 


o 


cn 


W"> 


m 


w^ 






Tf 






r- 


vo 


o 


00 


00 




00 


Os 


TT 


00 


00 








<N 






1 






(N 

i 










m 




<N 


ON 


<N 


cn 


<N 


00 




CN 


vr> 


r- 


00 


00 


00 


r- 


CN 


00 


00 


<N 


00 


00 


Tf 






f-H 

1 






c4 












i 






Ml 






NI 






N} 






NI 






CA 






CA 






CA 






CA 


C/5 




| 


CA 




1 


CA 




l 

z 

o 

s 


CA 




l 

z 

O 

s 


Uh 

a 

Uh 


LAD 


s 

o 

s 


FLCF 


LAD 


s 

O 

s 


FLCF 


LAD 


FLCF 


LAD 



00 rZ 
m 2 

<N ^ 
<N „ 



t 3I 



vo 

00 

o 



Tf 

on 



cn 

cn 



wo 

00 

<N 

r-* 

ON 



vo 

8 " 

<=> ii 

v t 3I 

o 

o 

l> 

00 

VO 



<N 

<N 



r- 

wo 



ON 

<N 



00 

oo 



m o 
o *— » 

O II 



-SI 



Pt 

<N 

VO 

ON 

Tf 



» 



cn 

ON 



00 



VO 


u 


cn 








cn 


^8 


<N 


CA 


OQ 


Sh 


3 


i 


s 


2 


<N 


g 


0 


:*fc 


5 


i 


O 




I 

Q 


1 

2 

00 


i 

a 


'S 


2 


ti 


§ 


a 


O 






a 


H 


Q 


ptf 



V ^3 
a 
cn 

8 

ON 

Tf 



ON 



m 

ON 



wo 

00 



§ 



Tf 

r- 



<N 



i 



3 

a 

§ 

c§ 

<N 



io 

^CKS,/ 



■tH 




Table 1 , cont. 



p 



C/5 

H— > 

i 

<D 

Oh 

<L> 

h-> 

C5 

c* 

4-> 

5 



G 

O 

C/5 

'S 

Oh 

s 

o 

U 



8 

s 

<u 

o 

§ 

*s 

> 

o 

U 

<4-1 

0 

g 

1 cS 
o-.J 3 
w 

a 

& % 

$S * 

H cx 

* Oh 



H 

t 



f§ 

M-h 

o 

C/5 

-G W) 

3 S 

(2 s 

w G 

#N c/5 

G c/5 
.2 < 
Hh 

•F Oh 

5 o 

C/5 .J 

« rT 

Q s 



D 

00 

S 

Q 



^ <N 

^ C* 

o o 

3 

o° 

9 3 



vo 


ON 


m 


VO 


On 


t-H 


m 


ON 


— < 


VO 


l> 


r- 




l> 


r- 


■'t 


vo 


CM 


vo 


r- 






4— H 
1 






1— H 
1 






cn 




T|- 


o 


o 


o 


00 


m 


T}- 


00 


8 


o 


I> 


r- 


o 


e'- 


vo 


vo 


r- 


vo 


vo 






<— H 
1 
















vo 


00 


o 


en 


m 


o 


00 


cn 


VO 


00 


l> 




vo 


t> 


l> 


q 


vo 


Tf 


On 


vo 






4— H 
1 












rn 








Ml 






Ml 






Ml 








w 






M 






C/5 




c/5 




| 


w 




l 


C/5 




| 


C/5 


Uh 




<5 


Uh 




a> 


Uh 




a) 


Uh 


a 


0 


£ 


u 


0 


55 


U 


0 




u 


Uh 


< 


o 

2 


hJ 

Uh 




o 

2 


Uh 


< 


o 

2 


u< 



2 8 
O ^ 
P n 



Si 



VO 

00 

o 

1/5 



G vo 
§ " 
P II 

V SI 

Ct 

CM 

r- 

CM 



8 2 

p ii 

v SI 

a 

oo~ 

8 

co 

Tf 



£ S5 8 



09 

Tf <N 

cm 



op CO ^ 



5 



i> 2 

vo ^ 



•SI 



oo 

cm 

o 

<N 



s 


II 


11 


II 


II 


5* 


<N 


<N 


»s 


(N 


" 


X 


X 


X 


X 


a 




00 


tj- 


Tf 












tf 


Tf 

On 


137 


00 

m 


00 

CO 


rt 


co 

00 


142 


00 

m 


o 


— 


113 


104 


100 


105 


Q 


CM 


vo 

CO 


85 


84 














vo 


i 

u 


Tf 


CM 






i 


CO 




d 

o 

U 


1 


PQ 

1 

m 


C/5 

r 


in 

s 


*C 


o 






r b 


o 

(A 


1 


o 


w 


0 


4) 

Q 


1 


•jL 


i 


i 

«s 


* 

CO 

1 


Q 

1 


2 

BO 

i 


Q 


d 

Q 

o 

o 


Q 


H 


Q 


PQ 


PQ 




m 




vo 


VO 




»“H 






1—* 



r- 

*■**$ 



co 

vH 




Table 1 , cont. 



<N 



C/3 

- 4 — k 

c 

8 

<u 

a< 

a 

2 
W 
• f-H 

a 



c 

0 

C/3 

'S 

1 

0 
U 

1 

C/3 

<D 

O 

’C 

cd 

s 

<D 

O 



*S 

s 

u 

<+H 

O 

>% 

cr .H 
w oo 

£ i 



C/3 

<L> 

H 

I 

<- 4 — i 

o 

C/3 



3 

<u 

P 4 



3 

& 

cu 

a* 

OX) 

c 



S 
3 

C to 

•B < 

&H [t] 

•c ft 



o 

C/3 

<D 

Q 

a 5 

c/3 

2 

Q 



U 

J 

PL, 



Q 

3 



<N 
03 O 



PH 

o 



& 

X 

o 
9 3 

J o 
H 



1 ^ 

2 | 
o- £> 



a. 

d* 

a“ 



§ 

•t 

0 

C /3 

03 

Q 

03 

CO 

1 

Q 



n \o oo 
VO vo vo 



oo cn Q 
^ m P 



O On 00 
vO vo co 






co o 
vO X 



i *51 



a 



vo 

vo 






oo 

co 



vo 

o 



Tj- 

3 



I 



1 

Q 

•» 

5 

PQ 



<N ON VO 

t- vo rf 



0° vo 2 

UN Nf 

<N 



VO F-* O 
VO vo ov 



Nl 



M 



§ 2 
°. II 

v -SI 
u 

t> 

VO 

00 

cn 






ON 

co 



o 

Tf 



cn 

o 



r- 



cn 



Oh 

S 



I 

o 

■8 

s 

« 



5 *> 



Tf cn 
vo vo co 



vo On on 
»O^S 



Nl 



§ 2 

® H 

v 5 g 

0 L 

cn 

Tf 

vo 

vo 






ON 

cn 



t-» 

cn 



vo 

o 



3 



cn 

# 

CN 

! 

5 

Q 

PQ 



»o o° g 
vo vo ® 



S !8 



O 

o 



On ^ cN 
vo vo t? 



§ 


i£ 8 


CO 

Uh 


§ 


CO 

Pu ^ 


§ 


o 




H 


3 J 


a 5 


S 5 

o 


2 


E 5 s 


E 


j 2 


E hJ 


s 



00 o 
cn ^ 
oo 

<N II 



"51 



u 

cn 

cn 

O 

CN 



X 

Tf 



00 

cn 



cn 



cn 

o 



CN 

vo 



tj- 

CN 

I 

I 

Q 

M 

o 

£ 

PQ 



o 

CN 



*05 



GO 




Table 1, cont. 



CO 



c 

<D 

s 

Oh 

1 



<4-1 

o 

c 

o 

C/5 



Oh 

6 

o 

O 



C/3 

<D 

O 

’C 



<u 



u 

4-1 

o 



csr 



13 "5 

C/D 

fe G 

^ \§ 
« * 
<L) 3 

H Oh 

^ o 



cS 



73 

4-1 D 

O a* 

C/3 W 
H— > 

*g w> 

3 g 
£ s 

w 3 

•" C/3 

C 

.2 < 

Dh r£ 

•c ft 

* E 



<L> 

00 

I 

Q 



Q 

< 

_1 




H 




On 


r- 


O 


on 


o vo 


On 


On 


o 


m 


*— < 1 . 






1 




cn 




cn 


5? 


on 


cn on 


3 


on 


tJ- 


Tf 






cn 






58 


55 


no 

ON 


§ 


28 *■ 
oo 










<N 






N1 




Nl 






CA 




CA 


(A 




l 


(A 


l 


PP 

U 

i 


9 


s 

£ 

o 


PU 

U 

j 


Uh 




s 


►— i 
PP 


J s 



^ VO 


on on 


8 « 


rn i/n 
o 


<=> II 


ii 


V tSI 


ii 'SI 


CL 


CL 


OO 


VO 


o 


on 


00 


on 


Tf 


c4 


on 





<s <s 




a 

o 

•I 

0 

V5 

a> 

Q 

a> 

or) 

1 

Q 



U 



0 

1 

s 

W) 

p 



m 

<N 

(A 

I 



3 

Q 

I 






<N 



<N 

<N 



CvJ 



o 

CO 




AREA' 1997 



i 



-TM0'?-70 c i I 



U.S. DEPARTMENT OF EDUCATION 
Office of Educational Research and Improvement (OERI) 
Educational Resources Information Center ( ERIC ) 

REPRODUCTION RELEASE 

(Specific Document) 



I. DOCUMENT IDENTIFICATION: 



Title: fW^rHvcic5 "W < R^kv~'S CAoS^ ^cc&i 


"’ 0,w Blue 1 


oac$) AS&ta . 1 


NWtis 


Corporate Source: 


Publication Date 



II. REPRODUCTION RELEASE: 





In order to disseminate as widely as possible timely and significant materials of interest to the educational community, documents 
announced in the monthly abstract journal of the ERIC system. Resources in Education (RlE). are usually made available to users 
in microfiche, reproduced paper copy, and electronic/optical media, and sold through the ERIC Document Reproduction Service 
(EDRS) or other ERIC vendors. Credit is given to the source of each document, and. if reproduction release is granted, one of 
the following notices is affixed to the document 

If permission is granted to reproduce the identified document, please CHECK ONE of the following options and sign the release 
below 



Sample sticker to be affixed to document 



Check here 

Permitting 

microfiche 

(4"x 6** film), 

paper copy. 

electronic. 

and optical media 

reproduction 



“PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC):* 



Level 1 




Sample sticker to be affixed to document 



or 

Permitting 
reproduction 
in other than 
paper copy. 



“PERMISSION TO REPRODUCE THIS 
MATERIAL IN OTHER THAN PAPER 
COPY HAS BEEN GRANTED BY 

TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC)" 



Level 2 



□ 

here 



Sign Here, Please 

Documents will be processed as indicated provided reproduction quality permits. If permission to reproduce is granted, but 
neither box is checked, documents will be processed at Level i. 



“1 hereby grant to the Educational Resources Information Center (ERIC) nonexclusive permission to reproduce this document as 
indicated above. Reproduction from the ERIC microfiche or electronic/optical media by persons other than ERIC employees and its 
system contractors requires permission from the copyright holder. Exception is made for non-profit reproduction by libraries and other 
service egencies to satisfy information needs of educators in response to discrete inquiries." 




PcdWv 


Printed Name: /\ a a t \ 

nVcjL 


Organization , ^ 

FUadcx fWWMc 




Telephone Number: / 


Date: . . 





« 



A 



CUA 




THE CATHOLIC UNIVERSITY OF AMERICA 

Department of Education, O’ Boyle Hall 
Washington, DC 20064 
202 319-5120 

February 21, 1997 , 

- . 

Dear AERA Presenter, 

Congratulations on being a presenter at AERA 1 . The ERIC Clearinghouse on Assessment and 
Evaluation invites you to contribute to the ERIC database by providing us with a printed copy of 
your presentation. 

Abstracts of papers accepted by ERIC appear in Resources in Education (RIE) and are announced 
to over 5,000 organizations. The inclusion of your work makes it readily available to other 
researchers, provides a permanent archive, and enhances the quality of RIE. Abstracts of your 
contribution will be accessible through the printed and electronic versions of RIE. The paper will 
be available through the microfiche collections that are housed at libraries around the world and 
through the ERIC Document Reproduction Service. 

We are gathering all the papers from the AERA Conference. We will route your paper to the 
appropriate clearinghouse. You will be notified if your paper meets ERIC's criteria for inclusion 
in RIE: contribution to education, timeliness, relevance, methodology, effectiveness of 
presentation, and reproduction quality. You can track our processing of your paper at 
http : // er icae2 . educ . cua . edu . 

Please sign the Reproduction Release Form on the back of this letter and include it with two copies 
of your paper. The Release Form gives ERIC permission to make and distribute copies of your 
paper. It does not preclude you from publishing your work. You can drop off the copies of your 
paper and Reproduction Release Form at the ERIC booth (523) or mail to our attention at the 
address below. Please feel free to copy the form for future or additional submissions. 



Mail to: AERA 1997/ERIC Acquisitions 

The Catholic University of America 
O' Boyle Hall, Room 210 
Washington, DC 20064 

This year ERIC/AE is making a Searchable Conference Program available on the AERA web 
page (http://aera.net). Check it out! 




^awrence M. Rudner, Ph.D. 
Director, ERIC/AE 



‘If you are an AERA chair or discussant, please save this form for future use. 




® 



lEHICl Clearinghouse on Assessment and Evaluation 



